Continuous fine-grained arm action recognition using motion spectrum mixture models

نویسندگان

  • Xi Zhao
  • Zhiming Gao
  • Tao Feng
  • Shishir Shah
  • Weidong Shi
چکیده

ELECT Motion sensors in smart wristbands/watches have been widely used to sense users’ level of movement and animation. Some studies have further recognised activity contexts using these sensors, such as walking, sitting and running. However, in applications requiring understanding of more complex activities such as interactions with other people or objects, it is necessary to recognise the fine-grained arm action during user interactions with other people or objects. A method to recognise a set of arm actions on a fine-grained level (e.g. checking the wristband, drinking water etc.) is proposed. Motion signals from the accelerometer and gyroscope are transformed into the frequency domain using the short-time Fourier transform. Then, the action patterns are represented by the motion spectrum mixture model and action dynamics are modelled by continuous density hidden Markov models. Tested on a dataset collected from 23 subjects, the method shows satisfying performance and efficiency.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Temporal and Fine-Grained Pedestrian Action Recognition on Driving Recorder Database

The paper presents an emerging issue of fine-grained pedestrian action recognition that induces an advanced pre-crush safety to estimate a pedestrian intention in advance. The fine-grained pedestrian actions include visually slight differences (e.g., walking straight and crossing), which are difficult to distinguish from each other. It is believed that the fine-grained action recognition induce...

متن کامل

Pipelining Localized Semantic Features for Fine-Grained Action Recognition

In fine-grained action (object manipulation) recognition, it is important to encode object semantic (contextual) information, i.e., which object is being manipulated and how it is being operated. However, previous methods for action recognition often represent the semantic information in a global and coarse way and therefore cannot cope with fine-grained actions. In this work, we propose a repr...

متن کامل

شناسایی نوع و مدل وسیله نقلیه با استفاده از مجموعه بخش‌های متمایز‌کننده

In fine-grained recognition, the main category of object is well known and the goal is to determine the subcategory or fine-grained category. Vehicle make and model recognition (VMMR) is a fine-grained classification problem. It includes several challenges like the large number of classes, substantial inner-class and small inter-class distance. VMMR can be utilized when license plate numbers ca...

متن کامل

Bimodal Spatial Reasoning with Continuous Motion

Symbolic AI systems typically have difficulty reasoning about motion in continuous environments, such as determining whether a cornering car will clear a close obstacle. Bimodal systems, integrating a qualitative symbolic system with a quantitative diagram-like spatial representation, are capable of solving this sort of problem, but questions remain of how and where knowledge about fine-grained...

متن کامل

Hand Detection and Tracking in Videos for Fine-Grained Action Recognition

In this paper, we develop an effective method of detecting and tracking hands in uncontrolled videos based on multiple cues including hand shape, skin color, upper body position and flow information. We apply our hand detection results to perform fine-grained human action recognition. We demonstrate that motion features extracted from hand areas can help classify actions even when they look fam...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2014